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ABSTRACT 

The results of the Pennsylvania Educational Quality 
Assessment program. Phase II, are interpreted. The first section of 
the manual presents a statement of each of the Ten Goals of Quality 
Education which served as the basis of the assessment. Also included 
are the key items on the questionnaires administered to 5th and 1 1th 
grade students. The second section concerns condition 
variables — their sources, and how raw data were transformed into 
condition variables. Section three provides norm tables showing the 
distributions on the measurement instruments in grades 5 and 11 in 
355 elementary and 73 secondary schools. In addition, tables provide 
condition variable norms for the two grades, along with condition 
variable indices. Tables also provide a summary of the variables used 
to predict school means and the weights applied to the variables. The 
percentile distributions for the total student sample of each of the 
two grade levels were computed and tabulated. The tables show 
percentile ranks, raw score equivalents, and the mean of each school 
as well as student distribution on five groupings — very high, high, 
middle, low, and very low. The manual concludes with instructions in 
how to read a norm chart with an illustration, and illustrations are 
also given of the form a school report takes. (For related documents, 
see TM 001 436, 437, 439.) (DB) 
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FOREWORD 



The Pennsylvania program of assessment is designed to translate the 
Ten Goals of Quality Education into measures of pupil performance which 
can be used to determine the effectiveness of school programs. Four factors 
were taken into account. They were: input, surrounding conditions, educa- 

tional processes and output. 

Pupils enter school with different abilities, values, and habits, and 
the school has to start with the children as it finds them. In assessing 
school programs, these differences must be considered. This is input. 

Surrounding conditions differ, --in the home, the school, and the community- - 
and impose unavoidable constraints on what a school can accomplish with its 
pupils. A school in an urban slum must cope with conditions vastly different 
from those confronting a school in an upper-class suburb. Such conditions 
had to be identified and measured. 

School programs differ. The quality of the school's educational processes 
were appraised by measuring the quality of its output. This meant measuring 
the abilities, attitudes, values, and habits of pupils completing each phase 
of the school program. 

Finally, the results of the assessment program were interpreted. Its 
value to you, the concerned educator, depends upon your willingness to use 
the results to discover your school's strengths and weaknesses and attempt to 
improve your educational programs accordingly. This manual is designed to help 
you understand the results of the assessment program as they pertain to your 
school. 
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QUALITY EDUCATION INSTRUMENTS 



A committee, appointed by the State Board of Education, formulated Ten 
Goals of Quality Education which served as the basis for assessment. A paper- 
and-pencil test, or instrument, was developed to measure each of the goals. 
These ten instruments formed the major portion of the questionnaires adminis- 
tered to 5th and 11th grade students in the schools sampled in the Phase II 
normative study as well as the students in the schools participating in Phase 
III. 

The following section contains a complete statement of each goal and a 
brief discussion of the rationale for its selection. Also included are key 
items on the instruments used to measure each goal and the percentage of 
students in the Phase II normative sample who chose the various response 
alternatives for these items. Key items are defined as those items which 
have high item to total correlations in each instrument. 



GOAL I 



QUALITY EDUCATION SHOULD HELP EVERY CHILD ACQUIRE THE GREATEST POSSIBLE UNDER- 
STANDING OF HIMSELF AND AN APPRECIATION OF HIS WORTHINESS AS A MEMBER OF SOCIETY. 



It is widely held that self-understanding is significantly associated with 
personal satisfaction and with effective functioning. The views which students 
have of their adequacies and their inadequacies and of their values and their 
desires can strongly influence their performance in school. 

Self-understanding is a personal judgment of worthiness, a subjective 
experience which individuals convey to others by verbal reports and other overt 
expressive behaviors. What are the conditions that lead individuals to value 
themselves and to regard themselves as persons of worth? Coopersmith (1967) 
discusses four major factors which contribute to the development of self- 
understanding: 

1. We value ourselves as we are valued. The amount of 
respectful accepting and concerned treatment we receive 
from parents, teachers and other significant persons can 
have a profound effect on the amount of worth we ascribe 
to ourselves. 

2. We achieve self-understanding when living up to aspi- 
rations in areas we regard as personally significant. 

All persons do not necessarily interpret indices of 
success and approval as equally favorable. 

3. We perceive success and esteem in light of our personal 
goals and values. 

4. Our manner of responding to devaluation can help us to 
maintain our self-respect or can lead us to minimize 
and distort it. The ability to defend the self in the 
face of negative appraisals helps us to reduce anxiety 
and maintain personal equilibrium. 

Quality education should provide the opportunity for students to achieve 
confidence in their personal attributes so that they will be able to make 
decisions, defend their positions and plan ahead. Quality education should 
provide the opportunity for all students to achieve in their schoolwork and to 
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gain confidence in their abilities to achieve academically. Finally, quality 
education should provide the opportunity for students to relate successfully to 
peers, teachers and parents. 



KEY ITEMS - GRADE 5 

Like Me Unlike Me 

E. 38. My parents understand me. 73% 21% 

E. 39. There isn't much of a chance for a person like 

me to succeed in life. 29% 67% 

E. 47. I'm proud of my schoolwork. 65% 31% 

KEY ITEMS - GRADE 11 

C. 39. My parents understand me 52% 42% 

C. 40. There isn't much of a chance for a person like 

me to succeed in life. 10% 85% 

C. 48. I'm proud of my schoolwork. 49% 45% 



GOAL II 



me 



QUALITY EDUCATION SHOULD HELP EVERY CHILD ACQUIRE UNDERSTANDING AND APPRECIATION 
OF PERSONS BELONGING TO SOCIAL, CULTURAL AND ETHNIC GROUPS DIFFERENT FROM HIS OWN. 



Quality education should provide the experience for students to respect and 
achieve an easy interaction with students who differ from themselves in physical 
characteristics, cultural traditions, economic status, religious beliefs and 
degree of intellectual competence. 

Students should be able to speak with and select as friends students of 
different origins and beliefs. They should actively seek information and 
participation which will increase their knowledge about other cultures and 
other social settings. To evaluate others, students should be helped to use 
empirical and objective criteria rather than stereotyped and hearsay informa- 
tion. 

KEY ITEMS - GRADE 5 



I would I wouldn't I would I would I 
like mind rather dislike cannot 

it it not it say 

D. 6. How would you feel about sitting 
in class next to a person whose 
skin color is different from 

your own? 15% 60% 6% 4% 11% 

D. 9. How would you feel about sitting 
in class next to a person whose 
ideas about God are very different 

from your own? 9% 46% 10% 11% 20% 

D. 12. How would you feel about sitting 
in class next to a person whose 

family is much poorer than yours? 12% 55% 6% 7% 16% 
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KEY ITEMS - GRADE 11 





I would 
like 
it 


I wouldn't 
mind 
it 


I would 
rather 
riot 


I would 
dislike 
it 


I 

cannot 

say 


6. How would you 
in class next 
skin color is 
your, own? 


feel about sitting 
to a person whose 
different from 


9% 


78% 


2% 


3% 


3% 


9. How would you feel about sitting 
in class next to a person whose 
ideas about God are very different 
from your own? 


6% 


76% 


3% 


4% 


7% 


12. How would you feel about sitting 
in class next to a person whose 
family is much poorer than yours? 


6% 


82% 


2% 


2% 


3% 
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GOAL III 



QUALITY EDUCATION SHOULD HELP EVERY CHILD ACQUIRE TO THE FULLEST EXTENT POSSIBLE 
FOR HIM MASTERY OF THE BASIC SKILLS IN THE USE OF WORDS AND NUMBERS. 

Mastery of the basic skills in the use of words and numbers is fundamental 
to achievement in all academic areas. Basic skills include the ability to acquire 
ideas through reading and listening, the ability to handle mathematical operations 
and the ability to reason logically and to respect evidence. The level of per- 
formance that can be reasonably expected in each of these areas will vary from 
school to school. However, it is of profound importance that the level of 
expectation in basic skills for any group of pupils shall not be underestimated 
or regarded as fixed. 

Research has shown that socioeconomic status and potential ability levels 
account for the most consistent and largest set of common variance in the achieve- 
ment of basic skills. Quality education should encourage the design of school 
programs which can be effective in spite of relatively low measured potential and 
relatively low social status. Moreover, it is plausible, and has been shown to be 
possible, that not only achievement but also intellectual potential can be modified 
by school processes. Fruitful program experimentation needs to focus on improving 
intellectual functioning or upon better utilization of existing intellectual 
functioning. 
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GOAL IV 



QUALITY EDUCATION SHOULD HELP EVERY CHILD ACQUIRE A POSITIVE ATTITUDE TOWARD 
SCHOOL AND TOWARD THE LEARNING PROCESS. 

Quality education should provide learning experiences which pupils find 
interesting, valuable, pleasant and active. Quality education should encourage 
pupils to display positive attitudes toward school assignments and positive 
attitudes toward the school climate. Pupils should express the interest and 
the desire to graduate from high school, express the opinion that learning does 
not end where formal education ends and express the desire to return to some 
type of educational setting from time to time as adults. 

KEY ITEMS - GRADE 5 

Almost Almost 









Always 


Often 


Sometimes 


Seldom 


Never 


H. 12. 


I like school. 




35% 


14% 


22% 


9% 


15% 


H. 15. 


Our school building 
















is nice to be in. 




37% 


19% 


22% 


9% 


9% 






KEY ITEMS - GRADE 11 














Almost 








Almost 








Always 


Often 


Sometimes 


Seldom 


Never 


D. 13. 


I like school. 




20% 


15% 


35% 


8% 


15% 


D. 18. 


Our school building 
















is nice to be in. 




26% 


' 18% 


28% 


9% 


13% 








Yes 




Uncertain 




No 


D. 24. 


I would like to quit 


school 














now or as soon as I • 


am ' 16 . 


3% 




5% 




87% 
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GOAL V 



QUALITY EDUCATION SHOULD HELP EVERY CHILD ACQUIRE THE HABITS AND ATTITUDES 
ASSOCIATED WITH RESPONSIBLE CITIZENSHIP. 

Quality education should encourage pupils to be willing to assume responsibility 
for their actions as well as the actions of the group. Opportunities should be 
provided for pupils to cooperate and work toward group goals and to demonstrate 
integrity in dealing with others. Pupils should be given the chance to take the 
initiative and assume leadership for group action as well as lend support to group 
efforts as followers. 

In order to make appropriate, reasonable decisions, pupils should make every 
effort to be informed by listening and reading. Schools should provide the 
opportunity for pupils to voice criticisms in a rational manner and work through 
group activity to bring about changes. Pupils should be encouraged to take an 
interest in their communities and become involved in community activities which 
support their beliefs. 



KEY ITEMS - GRADE 5 

Very Most of 

Never Seldom Sometimes the time Always 



I. 24. If a store clerk gave me too 
much change, I would return 

the extra money. 9% 7% 12% 13% 55% 

Disagree Neither Agree 

Strongly Disagree Agree or Agree Strongly 

Disagree 



I. 41 It's okay to break a school 
rule if everyone else is 

breaking it. 49% 22% 14% 10% 9% 
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KEY ITEMS 



Never 

B. 24. If a store clerk gave me too 
much change, I would return 
the extra money. 13% 



GRADE 11 








Very 




Most of 




Seldom 


Sometimes 


the time 


Always 


11% 


18% 


22% 


31% 



Disagree Neither Agree 

Strongly Disagree Agree or Agree Strongly 

Disagree 



B. 41. It's okay to break a school 
rule If everyone else Is 

breaking it. 41% 21% 22% 6% 4% 
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GOAL VI 



QUALITY EDUCATION SHOULD HELP EVERY CHILD ACQUIRE GOOD HEALTH HABITS AND AN 
UNDERSTANDING OF THE CONDITIONS NECESSARY FOR THE MAINTAINING OF PHYSICAL AND 
EMOTIONAL WELL-BEING. 

Facts and understandings about the structure and function of the human body, 
diseases and their prevention, emotional and social adjustment, environmental 
hazards, posture and body mechanics, dental health, food and nutrition, personal 
hygiene and first aid and safety are all essential requirements for successful 
achievement in Goal VI. 

In their own interests as well as in the interests of society at large, 
pupils should know how to keep themselves mentally and physically fit. They 
should have an awareness of those practices which may be harmful to their physical 
and mental well-being as well as an awareness of those practices which may be 
beneficial. 

KEY ITEMS - GRADE 5 

^•31. Which of the following is not likely an effect of smoking? 

A. Shortness of breath 

B. Lung cancer 

C. Good appetite 



9% 

23% 

64% 



C.25. When should boys and girls have a health examination? 



A. 


Only when they are 






sick. 


10% 


B. 


Only when their 






parents can afford 






it. 


13% 


C. 


At least every 






three years. 


73% 
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KEY ITEMS - GRADE 11 



A. 36. The best time to visit a dentist is 

A. When you think you need treatment. 5% 

B. When you know you need treatment. 4% 

C. At regular intervals 80% 

D. At the first sign of a toothache. 3% 

E. When you can't stop a toothache. 2% 

A. 54. John purchased a second-hand car which was in excellent 
condition. If you were John, you would consider it poor 
safety practice to 



A. Keep regular check on the car's 

mechanical condition. 8% 

B. Refuse to pick up hitchhikers. 8% 

C. Be courteous to others using the 

road. 6% 

D. Drive consistently at a very 

low speed. 62% 

E. Drive only when alert. 6% 
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GOAL VII 



QUALITY EDUCATION SHOULD GIVE EVERY CHILD OPPORTUNITY AND ENCOURAGEMENT TO BE 
CREATIVE IN ONE OR MORE FIELDS OF ENDEAVOR. 



Definitions of creativity can usually be classified into three categories, 
depending on whether the emphasis is on the product, the process or the sub- 
jective experience. The EQA rationale for Goal VII states that: 

1. There is a student potential for creative output. All students have 
within themselves more or less ability to participate in creative activities and 
to express their behaviors in a verbal, visual or tangible product. Creative 
abilities include: 

a. Self-Direction — students are able to complete the task at 
hand by employing their own resources. 

b. Evaluative Ability — students recognize that their own ideas have 
worth even if these ideas are not always approved by others 

and express reasonable balance in opinions of their work. 

c. Flexible Thinking — students are not confined to a single 
approach to problems. They are willing to consider views 
different from their own and are not adverse to shifting 
context. 

d. Original Thinking — students are able to see new relationships, 
are willing to search for novel approaches and are interested 
in making new compositions. 

e. Elaborative Thinking — students desire to develop projects 
beyond minimum requirements and are interested in outcomes 
and implications. 

f. Willingness to Take Risks — students are not so sensitive to 
criticisms that they are not able to support their own view; 
they are willing to accept challenges and are responsive to 
opportunities to set their own goals. 

g. Ease with Complexity — students like to toy with complex ideas, 
enjoy coping xjith knotty problems and are challenged by com- 
plications. 

2. There are conditions under which creative behavior is more likely to occur. 
Classroom climates can serve to enhance or inhibit the processes and experiences 

of creativity. Depending on the classroom conditions, potential abilities can 
be thwarted or can thrive. 
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3. There are characteristics which seem to define creative output, whether 
the product be tangible or ideational, complete or incomplete. These character- 
istics include: 

a. Newness of Approach — students have accomplished purposeful 
searches for different pathways to the anticipated product 
other than those which have been commonly followed in the past. 

b. Originality — students have accomplished independent and/or 
spontaneous, firsthand productions with freshness of aspect 
or design or newness of style or character. 

c. Adaptiveness — students have modified methods, artifacts or 
processes to serve different purposes, to fit new sets of 
requirements or to produce different products. 

d. Occupational Uniqueness — students have accomplished pro- 
ductions which are not usually expected of high school students. 

e. Evocation of Feeling and Communication of an Idea — students 
have accomplished productions which transmit feelings or 
ideas to others. 

When a product displays one or more of these characteristics, recognition is 
often bestowed. 



KEY ITEMS - GRADE 5 



Strongly Strongly 

Agree Agree Uncertain Disagree Disagree 

F. 24. I enjoy learning how to do 
something in a new and 



different way. 


34% 


37% 


14% 


6% 


4% 


F. 40. Pictures of grass could 
be painted any color. 


13% 


20% 


21% 


25% 


16% 




KEY ITEMS - 


GRADE 11 









How creative 


do you 


feel you are? How able 


are you to 


come up with new ideas 


that work? 












A. 


Highly creative 




7% 




B. 


Somewhat more creative 


than most 


21% 




C. 


Moderately creative 




46% 




D. 


Somewhat less creative 


than most 


15% 




E. 


Not very creative 




6% 


How often do 


you like to fool around with new ideas, even if they turn out to 


be a total waste of 


time? 








A. 


Almost always 


* 


12% 




B. 


Frequently 




30% 




C. 


Sometimes m 




35% 




D. 


Rarely *;/ 




12% 




E. 


Never 




5% 
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GOAL VIII 



QUALITY EDUCATION SHOULD HELP EVERY CHILD UNDERSTAND THE OPPORTUNITIES OPEN TO HIM 
FOR PREPARING HIMSELF FOR A PRODUCTIVE LIFE AND SHOULD ENABLE HIM TO TAKE FU LL 
ADVANTAGE OF THESE OPPORTUNITIES. 

Quality education should provide the opportunity for students to discover the 
practically unlimited possibilities for continuing self -development in the world 
of work. Processes rather than specific points in time describe the manner in 
which individuals move toward vocational maturity. 

At the beginning stages of vocational maturity pupils are aware of different 
kinds of work and workers and have a growing understanding of the relatedness of 
educational and occupational opportunities. The more vocationally mature students 
will show involvement in the choice process by actively seeking information, will 
take personal responsibility for career decisions and finally will base their career 
choices upon a realistic appraisal of their interests, achievement and aptitudes. 

KEY ITEMS - GRADE 5 





TRUE 


FALSE 


G. 36. You get into an occupation mostly by chance. 


37% 


57% 


G. 41. I have little or no idea what working will be 
like. 


48% 


48% 


GRADE 11 






G. 36 . You get into an occupation mostly by chance. 


13% 


80% 


G. 41. I have little or no idea what working will be 
like. 


20% 


73% 
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GOAL IX 



QUALITY EDUCATION SHOULD HELP EVERY CHILD TO UNDERSTAND AND APPRECIATE AS MUCH AS 
HE CAN OF HUMAN ACHIEVEMENT IN THE NATURAL SCIENCES, THE SOCIAL SCIENCES AND THE 
ARTS. 



Pupils should be encouraged and helped first to gain knowledge about human 
accomplishments. Possessing knowledge they will then be ready to receive and not 
to avoid the stimuli that the sciences and the arts provide. At the next level, 
they will be ready to more clearly and consciously perceive these s tim uli and will 
begin to discriminate among art forms. When they reach this stage of development, 
they will be ready to respond rather than merely attend to phenomena — they will 
choose to see a play, to read of a famous scientist or to contemplate the design 
of a building. 

Reaching a higher level of development, they will gain satisfaction in responding. 
Music will become an emotional involvement. Politics will become a zealous pursuit. 
Reading will become a vicarious experience. 

At the highest level of development, students will exhibit a degree of sensi- 
tivity that enables them to differentiate the worthy from the worthless in the 
multifarious products of civilization — books, motion pictures, radio, TV, music, 
the visual and performing arts, architecture, industrial design and literature. 



KEY ITEMS - GRADE 5 



A. 19. Would you like to visit 
a theater to see a play? 



Yes 

80% 



No Cannot Say 

8 % 8 % 



48% 





A. 17. Would you like to take part 
in musical activities? 



31% 



17% 



I 



KEY ITEMS - GRADE 11 



Yes 



H. 23. If you had the opportunity, would 

you like to attend a symphony concert? 24% 



Maybe 



No 



Agree 



26% 44% 

Cannot Say Disagree 



H. 50. Most works of art are too difficult 
to understand. 



39% 



32% 
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GOAL X 

QUALITY EDUCATION SHOULD HELP EVERY CHILD TO PREPARE FOR A WORLD OF RAPID CHANGE 
AND UNFORESEEABLE DEMANDS IN WHICH CONTINUING EDUCATION THROUGHOUT HIS ADULT LIFE 
SHOULD BE A NORMAL EXPECTATION. 



Quality education should help students develop attitudes of openness to the 
possibilities of change — change in their personal world as well as external change. 
Students should be encouraged to show tolerance for ambiguity and to welcome new 
experiences. Students should learn to view education as an important and essential 
activity that does not end when formal schooling ends. 



KEY ITEMS - GRADE 5 



B, 11. In 1989 there will be no attendance 
rules. Pupils can use the school 
building as many days each year as 
they wish. Pupils can come and go 
anytime. 

B. 42. In 1989 there will be no required 
subjects. Pupils can take any 
subjects they wish to take. 



KEY ITEMS 

I accept it say accept it 

I. 11. In 1989 there will be no attendance 
rules. Pupils can use the school 
building as many days each year as 
they wish. Pupils can come and go 

anytime. 35 % 12% 46% 

I. 12. In 1989 there will be no required 
subjects. Pupils can take any 

subjects they wish to take 53% 12% 29% 
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I like it 



I cannot 
say 



I don't 
like it 



/ 



. / 
4 S' 



54% 




- GRADE 11 



I cannot I do not 
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Reliability and Validity' 



Internal consistency reliability^cdef f icients were computed for all EQA 

inventories. When data were analogous to the usual right-wrong response form, 

* / 

the Kuder-Richardson formula'' 20 was used. Where the response pattern was a matter 
of degree, Cronbach's'-'coef f icient alpha was computed. 

All of/tfie EQA inventories have content validity. Their contents were 
"validapa'd" according to the rationales developed for each of the ten goals by 
tjj^EQA staff or measurement researchers both locally and nationally. Evidence 
of construct validity for most of the inventories was obtained through factor 
analysis. Some of the inventories have been subjected to criterion related 
validity tests. 

Reliability and validity are neither completely dichotomous, general 
nor absolute. Users must make the decisions about the adequacy with which these 
concepts are fulfilled in each situation. Validity studies of the EQA inventories 
continue so that information about the performance of these measures under a 
variety of circumstances may be gathered in order to assess their appropriateness 
for any given situation. 

Section 3 of Phase II Findings discusses in detail the validity informa- 
tion collected about the EQA inventories. Section 4 of Phase II Findings presents 
in detail the technical properties of each of the EQA inventories. Characteristics 
of the EQA instruments used to measure the quality education goals for Grades 5 and 
11 are summarized in Tables I and II respectively. 
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TABLE I 

GRADE 5 SUMMARY OF INSTRUMENTS 
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TABLE lT 

GRADE 11 SUMMARY OF INSTRUMENTS 



CONDITION VARIABLES 



Source of Condition Variable Data 

In October of 1969 a survey was conducted of 20,000 fifth and 17,000 
eleventh grade students in 355 elementary and 73 high schools across 
Pennsylvania. These schools act as the reference group for schools parti- 
cipating in Phase III. Students provided information on the occupation and 
education of their parents, the type of communities in which they were living, 
the availability of school resources, etc. 

Concurrently, teachers and administrators employed in the above schools 
were also queried. The instructional staff sample was composed of 1,077 
elementary and 852 secondary teachers. These teachers responded to a seventy- 
six item questionnaire that was designed to measure their job satisfaction, 
career aspirations, innovativeness in the classroom situation, etc. In 
addition to the information obtained from the teacher questionnaire, the Pro- 
fessional Personnel Record, developed by the Bureau of Statistics, was used 
to measure other condition variables such as: teacher experience, teacher 

education, teacher salary, and teacher sex. 

A school information form was sent to school administrators to obtain 
data on the community and on various school programs. School financial data 
were collected from other Bureaus in the Education Department --primari ly from 
the Bureau of Statistics. 



How Raw Data Were Transformed into Condition Variables 



An index score on each of the condition variables was computed for 
each participating school. In many cases, the original data submitted to 
the Bureau were in the form of specific responses to specific items on the 
school, teacher, and pupil questionnaires. Some of these items were trans- 
lated into condition variable data by calculating ratio scores, such as 
number of teachers per pupil and books per pupil. Other items, were scaled 
with weights predetermined according to the degree of presence of the char- 
acteristic that they were designed to measure. By averaging the weighted 
responses given by individuals to these items, mean index scores were com- 
puted for each school. 

The indices fall into three major classes: school and community char- 

acteristics, instructional staff characteristics, and student characteristics. 
The indices are described in Tables III, IV, and V. 
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TABLE III 

SCHOOL AND COMMUNITY INDICES 
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CONSTRUCTION OF EDUCATION PROFILES 

At the present time all goal inventories used by the Bureau of Educational 
Quality Assessment are "norm-referenced" as opposed to "criterion-referenced" 
measures. The former types of tests are used to ascertain a school's perform- 
ance in relationship to other schools on the same measuring device. It is 
mandatory when using inventories such as these to offer the participating 
Phase III school several relevant comparison groups which can aid the school's 
administrators to evaluate their school's scores on the inventories. 

As a first step in this direction the Bureau prepared separate norm tables - 
from the 5th and 11th grade assessment data on (1) each of the ten quality 
education instruments and (2) each of the condition variables. 

Pennsylvania School Norms: Quality Education Inventories 

For these norms the unit of analysis was the school mean. The norm tables 
were constructed by computing a percentile distribution for each assessment 
instrument. Each percentile distribution is a ranking of mean school scores 
which is divided into 100 equal parts. Each part has an equal number- -one per 
cent--of the total number of school scores. 

A "percentile" can be described as a point on this 100-point scale which 
gives the per cent of cases that fall below that particular point. For 
example, a school whose test score places it at the 70th percentile rank 
equals or exceeds 70 per cent of the sample on which the test was standardized. 
This score can also be interpreted to mean that the remaining 30 per cent of 
the schools in the standardization group exceeded its test performance. 

The two tables entitled "Pennsylvania School Norms --Grade 5 and Grade 11" 
express the distributions on the Quality Education instruments for the 355 

elementary schools and 73 secondary schools sampled to establish norms. 
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On these tables the column on the far left represents the percentile 
ranks of the distributions. The numbers in the main body of the table are 
the raw score equivalents on each instrument corresponding to a given per- 
centile rank. 

The norm tables also present the mean and standard deviation of the dis- 
tribution of scores for each instrument. 



32 




28 



o 

ERLC 




TABLE VII 



Pennsylvania School Norms: Condition Variables 



Pupil achievements in the goal areas must be considered in light of sur- 
rounding conditions. The assessment model takes into consideration those 
factors the pupil brings with him, those particular conditions the surrounding 
community offers him, and those school characteristics which affect him. 

In order to give the Phase III. school personnel information on how the 
school stands in relation to other schools in the state on these condition 
variables, percentile distributions were constructed from the Phase II educa- 
tional correlate data. Tables VIII, IX, and X represent the Grade 5 condition 
variable norms and Tables XI, XII, and XIII the Grade 11 norms. The mean and 
standard deviation of each index are also displayed on these tables. 

Caution must be used when interpreting these condition variable norms. 
High percentile ranks on these indices do not necessarily indicate that the 
school of interest has more favorable conditions with which to work. Indeed, 
many of the indices show negative relationships with achievement on the edu- 
cational goal instruments. Condition variable indices are included in this 
manual to give Phase III school personnel a clearer picture on how these 
conditions are distributed across the state. When using these tables it is 
important to keep in mind how each of the indices was constructed. 
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TABLE XII 



PERCENTILE DISTRIBUTION OF STUDENT INDICES FOR SECONDARY SCHOOLS 
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Prediction of School Means 



The Pennsylvania School Norm tables discussed above were constructed to 
aid the Phase III school administrators in determining where their schools 
stand on the achievement of the ten goals in relation to a state reference 
group. However, it was realized that a comparison group that included a 
cross section of schools throughout the state might not be equally relevant 
to all Phase III schools. Therefore , the Pennsylvania assessment program 
was designed to take into account differing home, school, and community 
conditions that might limit what a school can accomplish with its pupils. 

To accomplish this end the Bureau developed "prediction equations"* for 
each of the ten quality education instruments based upon statistical relation- 
ships between Phase II school scores on the instruments and the measured 
condition variables. The procedure involved correlating each of the variables, 
both output and condition, with every other variable. The zero order correla- 
tions were then used as a basis for multiple correlation coefficients. For a 
more thorough explanation of the procedures used to determine the prediction 
equations, refer to Section Six of the Phase II Findings. 

Taking into account (1) the school, community, and student conditions that 
are related to scores on the goal instruments and (2) the unique combination of 



*These prediction equations take the general form: 

$ = b-j^ + b 2 x 2 +....+ b i x^ c + a 

A 

where Y = predicted school mean 

x l ,,,,x lc = sc h°°l condition variables used to predict the 
school mean 

b^...,b. = regression weights applied to each variable to 
maximize prediction accuracy 
a = constant used to maximize prediction accuracy 
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these conditions that the school of interest possesses, the equations predict 
school scores on each of the instruments. A summary of the variables used to 
predict school means on each instrument and the weights applied to these 
variables to maximize the accuracy of the school prediction is given in 
Tables XIV and XV. 

Caution must be used when evaluating these variables and their respective 
regression weights. The inclusion of any one condition variable in the set 
of condition variables used to predict the school mean does not imply that 
(1) it "causes 11 school outcomes to be higher or lower or (2) that it necessarily 
has the highest relationship with the outcome (i.e., goal instrument) in ques- 
tion. Rather, the variables included in the prediction equation should be 
looked upon as the set of condition variables that when taken into account with 



their appropriate weights can maximize the accuracy of a school mean prediction. 



TABLE XIV 

CONDITION VARIABLES, REGRESSION WEIGHTS, AND CONSTANTS FOR 



SCHOOL 


MEAN PREDICTION EQUATIONS 


ON 10 EQA INSTRUMENTS 


: GRADE 5 




GOAL 

INSTRUMENT 


VARIABLES USED TO 
PREDICT SCHOOL MEAN 


REGRESSION WEIGHTS 
APPLIED TO 
EACH VARIABLE 


CONSTANT FOR 
PREDICTION EQUATION 





FOCC 


.053 




I 


TSTABL 


.775 




Self 


TEXPER 


.052 


80.04 


Understanding 


SUBSIDY 


-.005 






HOUSING 


.656 







LPL 


.110 




II 


FEDUC 


.835 




Understanding 


TSTABL 


-.523 


24.95 


Others 


TCAREER 


.102 






TSEX 


1.168 







LPL 


.077 




III 


SEX 


.281 




Basic 


FAMSES 


.004 


1.99 


Skills 


TEXPER 


.007 






INSEXADM 


-.001 






GUIDANCE 


-.054 





IV 

Interest 
in School 


MEDUC 

LOCATION 

FAMSES 

CLPRACT 

TSEX 

ENROLL 


2.022 

.253 

-.037 

.153 

-1.825 

.001 


48.14 




LPL 


.888 




V 


FEDUC 


1.804 


105.90 


Citizenship 


SEX 


10.108 






TEXPER 


.176 







LPL 


.403 




VI 


MEDUC 


.960 


5.77 


Health Habits 


RACE 


.904 






TEXPER 


.061 







LPL 


.716 




VII 


FEDUC 


1.601 




Creativity 


SEX 


7.288 


93.81 




TEXPER 


.140 






ENROLL 


.002 
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TABLE XIV-: (c ontinued ) 



GOAL 

INSTRUMENT 


VARIABLES USED TO 
PREDICT SCHOOL MEAN 


REGRESSION WEIGHTS 
APPLIED TO 
EACH VARIABLE 


CONSTANT FOR 
PREDICTION EQUATION 




LPL 


.159 




VIII 


FOCC 


.036 




Vocational 


RACE 


.788 


51.12 


Development 


TAGE 


.088 






TLOCALE 


-.447 







SEX 


3.603 




IX 


LOCATION 


.155 




Appreciating 


TLOCALE 


.330 


42.55 


Human 


TCAREER 


.172 




Accomplishments 


SUBSIDY 


.003 







FEDUC 


2.560 




X 


MEDUC 


-2.318 




Preparing for a 


SEX 


-4.599 


105.98 


Changing World 


TAGE 


-.428 






TCAREER 


.315 






GUIDANCE 


1.014 
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TABLE XV 

CONDITION VARIABLES, REGRESSION WEIGHTS, AND CONSTANTS FOR 
SCHOOL MEAN PREDICTION EQUATIONS ON 11 EQA INSTRUMENTS: GRADE 11 



GOAL 

INSTRUMENT 


VARIABLES USED TO 
PREDICT SCHOOL MEAN 


REGRESSION WEIGHTS 
APPLIED TO 
EACH VARIABLE 


CONSTANT FOR 
PREDICTION EQUATION 




LOCATION 


.273 






RACE 


-1.342 






COUNSEL 


.868 






VALUES 


2.479 






TSTABL 


1.579 


. 


I 


TMEDUC 


.401 




Self 


REACTL 


-.577 


68.39 


Understanding 


TS ALARY 


-.0008 






TEDUC 


1.939 






POSTGRAD 


-.027 






EFFORT 


.095 






ENROLL 


.001 






HOUSING 


.401 






GUIDANCE 


205.134 







LPL 


.131 






LOCATION 


.400 






MORESB 


1.732 






VALUES 


4.093 




II 


PCTMW 


4.816 




Understanding 


TCOLLEGE 


-1.944 


57.78 


Others 


TSTABL 


1.039 






TMEDUC 


.586 






TFOCC 


.449 






DISCREP 


-.314 






STAFFP 


49.848 






BOOKS P 


-.088 





III 

Basic Skills 


LPL 

TSTABL 

TCAREER 


.080 

.150 

.032 


1.33 




LIBRARY 


3.390 






MORESB 


2.876 






VALUES 


3.105 






ATTEND 


2.482 






MOCC 


.095 




IV 


PCTMW 


7.267 




Interest 


TAGE 


.889 


23.72 


in School 


TPPOS 


-1.865 






TSTABL 


1.633 






TSATISF 


.460 






POSTGRAD 


-.056 






INSEXADM 


-.008 






HOLDING 


.107 






GUIDANCE 


1372.092 







TABLE XV: (continued) 



GOAL 

INSTRUMENT 


VARIABLES USED 
PREDICT SCHOOL MEAN 


REGRESSION WEIGHTS 
APPLIED TO 
EACH VARIABLE 


CONSTANT FOR 
PREDICTION EQUATION 




RACE 


3.284 






LIBRARY 


4.381 






VALUES 


9.507 






ATTEND 


5.033 






OCDES IRE 


.506 




V 


OCEXPECT 


-.649 




Citizenship 


TAGE 


1.721 


• 69.08 




TCOLLEGE 


-3.320 






TLOCALE 


2.269 






TMEDUC 


2.254 






TSALARY 


-.0013 






ENROLL 


.001 






STAFFP 


105.264 






GUIDANCE 


723.131 







LPL 


.394 






SEX 


9.291 






LOCATION 


-.635 






LIBRARY 


-1.696 






COUNSEL 


1.371 






MORESB 


7.361 


43.77 


VI 


MORES G 


-5.871 




Health 


VALUES 


3.445 




Habits 


ATTEND 


2.252 






TLOCALE 


1.790 






TMEDUC 


1.600 






TEDUC 


2.855 







ATTEND 


-1.265 




VII-P 


OCDES IRE 


.115 




Creative 


FAMSES 


.038 


54.37 


Potential 


INSEXADM 


.006 






ENROLL 


-.001 







LPL 


-.110 






SEX 


-9.655 






LOCATION 


-.472 




VII-0 


RACE 


-2.689 




Creative 


LIBRARY 


1.890 


174.73 


Output 


OCEXPECT 


.187 






PCTMW 


- 4.724 






TSTABL 


-4.149 






SUBSIDY 


.006 






EFFORT 


-.217 
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TABLE XV: (continued) 



GOAL 

INSTRUMENT 


VARIABLES USED 
PREDICT SCHOOL MEAN 


REGRESSION WEIGHTS 
APPLIED TO 
EACH VARIABLE 


CONSTANT FOR 
PREDICTION EQUATION 




LPL 


.177 




VIII 


SEX 


4.747 




Vocational 


VALUES 


2.304 


60.89 


Development 


TFOCC 


.425 






DISCREP 


-.380 






ENROLL 


.001 







LPL 


.370 






SEX 


7.072 






LOCATION 


.562 






MORES B 


3.570 






VALUES 


5.547 




IX 


ATTEND 


3.118 




Appreci ating 


MOCC 


.071 


76.57 


Human 


PCTMW 


7.223 




Ac c omp 1 i s hnien t s 


TPPOS 


-1.185 


, 




TCOLLEGE 


-3.242 






TLOCALE 


2.971 






REACTL 


-.325 






RECIDEA 


1.164 






TSATISF 


.219 






STAFFP 


52.541 






RACE 


1.293 






MORES G 


-2.384 






VALUES 


10.734 






MOCC 


.073 






FAMSES 


.050 




X 


TCOLLEGE 


-2.783 




Preparing for a 


TCAREER 


-.364 


95.99 


Changing World 


TSATISF 


-.413 






DISCREP 


-.708 






CLPRACT 


-.255 






TSALARY 


-.0010 






IEXPER 


.154 






BOOKS P 


.130 






GUIDANCE 


-849.114 






INNOVATE 


.049 
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Student Distributions: Quality Education Instruments 



The instruments employed by the Bureau are not intended for use in 
diagnosing individual students within the school. However, when one evaluates 
his school's performance in the goal areas, it becomes increasingly important 
to take into account not only the average performance level of. the student 
body, but also how the students within the school distribute themselves on 
each goal instrument. Indeed, two schools could have similar mean scores yet 
display very different student distributions. 

With this in mind, state student percentile distributions were computed 
for each grade level using the entire Phase II student sample. Columns 2 and 
3 in Table XVI show percentile ranks and their corresponding raw score equiv- 
alents for Grade Five inventories. Columns 2 and 3 in Table XVII display similar 
information on the goal inventories for Grade Eleven students. 

Distributions comprising a cross section of students throughout the state 
might not be equally relevant to all Phase III schools. The questions may 
arise: Do higher scoring schools have different student distributions from 

lower scoring schools? If so, in what ways are these distributions different? 

To give answers to these questions and to provide additional relevant compari- 
son groups the following procedure was carried out. 

For each of the inventories for Grades Five and Eleven, the Phase II 
schools were partitioned into five groups according to their mean on that 
instrument. The five school groupings were: 

GROUPING CRITERION FOR INCLUSION IN GROUP 

Very High Schools scoring more than 1.5 S.D. 

above the state average 

High Schools scoring .5 to 1.5 S.D. above 

the state average 
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Middle 



Schools scoring .5 S.D. above the 
state average to .5 S.D. below it 

Low Schools scoring .5 to 1.5 S.D, below 

the state average 

Very Low Schools scoring more than 1.5 S.D. 

below the state average 

Separate student distributions were then computed for each of the five 
school groupings. Columns 4 through 8 in Tables XVI and XVII display these 
student distributions for Grade Five and Grade Eleven respectively. 
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Predicted Student Distributions 

Each participating Phase III school will receive for each inventory a 
range of scores within which its mean score is expected to fall. Concurrently 
the school will receive a predicted student distribution corresponding to its 
predicted mean score. The distributions that are presented in the individual 
school report depend upon which of the above five school groupings its predicted 
school mean falls for each inventory. 
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TABLE XVI 

STUDENT DISTRIBUTIONS FOR FIVE SCHOOL GROUPINGS 
ON EQA INSTRUMENTS: GRADE 5 



INSTRUMENT 


PERCENTILE 

RANK 


RAW SCORE 
EQUIVALENT 


7ERY LOW- 
SCORING 
SCHOOLS 


LOW- 
SCORING 
SCHOOLS . 


MIDDLE- 
SCORING 
SCHOOLS . 


HIGH- 

SCORING 

SCHOOLS 


VERY HIGH- 
SCORING 
SCHOOLS 




81 and above 


95 and above 


8% 


14% 


20% 


28% 


39% 


Self 


61-80 


90-94 


11% 


16% 


20% 


21% 


22% 


Understanding 


41-60 


85-89 


20% 


21% 


20% 


20% 


19% 




21-40 


80-84 


25% 


24% 


21% 


17% 


12% 




20 and below 


79 and below 


36% 


25% 


19% 


14% 


8% 




81 and above 


37 and above 


9% 


12% 


19% 


25% 


34% 


Understanding 


61-80 


35-36 


10% 


16% 


19% 


26% 


29% 


Others 


41-60 


32-34 


18% 


21% 


22% 


21% 


20% 




21-40 


28-31 


26% 


25% 


21% 


16% 


11% 




20 and below 


27 and below 


37% 


26% 


19% 


12% 


6% 




81 and above 


581 and above 


3% 


11% 


19% 


31% 


48% 


Basic 


61-80 


521-580 


8% 


15% 


22% 


25% 


25% 


Skills 


41-60 


468-520 


13% 


20% 


22% 


20% 


16% 




21-40 


416-467 


21% 


25% 


21% 


16% 


8% 




20 and below 


415 and below 


55% 


29% 


16% 


8% 


3% 




81 and above 


67 and above 


6% 


12% 


18% 


27% 


37% 


Interest 


61-80 


62-66 


9% 


16% 


19% 


21% 


24% 


in School 


41-60 


57-61 


14% 


21% 


23% 


22% 


19% 




21-40 


52-56 


26% 


21% 


20% 


17% 


12% 




20 and below 


51 and below 


45% 


30% 


20% 


13% 


8% 




81 and above 


182 and above 


8% 


11% 


19% 


26% 


33% 


Citizenship 


61-80 


170-181 


9% 


15% 


20% 


24% 


31% 




41-60 


156-169 


12% 


17% 


21% 


21% 


21% 




21-40 


139-155 


28% 


27% 


21% 


18% 


11% 




20 and below 


138 and below 


43% 


30% 


19% 


11% 


4% 




81 and above 


35 and above 


3% 


10% 


16% 


25% 


37% 


Health 


61-80 


31-34 


8% 


18% 


25% 


29% 


33% 


Habits 


41-60 


28-30 


11% 


16% 


18% 


18% 


16% 




21-40 


23-27 


26% 


24% 


21% 


16% 


10% 




20 and below 


22 and below 


52% 


32% 


20% 


12% 


4% 




81 and above 


153 and above 


4% 


11% 


18% 


27% 


35% 


Creativity 


61-80 


143-152 


10% 


16% 


21% 


24% 


29% 




41-60 


134-142 


17% 


19% 


21% 


21% 


18% 




21-40 


124-133 


25% 


24% 


21% 


16% 


11% 




20 and below 


123 and below 


44% 


30% 


19% 


12% 


7% 




81 and above 


65 and above 


5% 


12% 


19% 


27% 


39% 


Vocational 


61-80 


61-64 


14% 


19% 


24% 


28% 


29% 


Development 


41-60 


59-60 


15% 


18% 


17% 


15% 


15% 




21-40 


56-58 


27% 


23% 


21% 


18% 


10% 




20 and below 


55 and below 


39% 


28% 


19% 


12% 


7% 




81 and above 


57 and above 


9% 


15% 


21% 


28% 


37% 


Appreciating 


61-80 


54-56 


13% 


18% 


21% 


23% 


23% 


Human 


41-60 


51-53 


18% 


21% 


20% 


20% 


20% 


Accompl ishment 


s 21-40 


48-50 


17% 


17% 


17% 


14% 


11% 




20 and below 


47 and below 


43% 


29% 


21% 


15% 


9% 




81 and above 


115 and above 


7% 


13% 


19% - 


29% 


39% 


Preparing 


61-80 


106-114 


11% 


15% 


18% 


21% 


25% 


for a 


41-60 


97-105 


18% 


22% 


22% 


19% 


18% 


Changing World 


21-40 


88-96 


. 27% 


23% 


21% 


17% 


11% 




20 and below 


87 and below 


' 37% 


27% 


20% 


14% 


7% 
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TABLE XVn 

STUDENT DISTRIBUTIONS FOR FIVE SCHOOL GROUPINGS 
ON EQA INSTRUMENTS: GRADE 11 



INSTRUMENT 


PERCENTILE 

RANK 


RAW SCORE 
EQUIVALENT 


VERY LOW- 
SCORING 
SCHOOLS 


L0W- 

SC0RING 

SCHOOLS 


MIDDLE - 
SCORING 
SCHOOLS 


HIGH- 

SCORING 

SCHOOLS 


VERY high- 
scoring; 

SCHOOLS 


81 and above 


97 and above 


m 


14% 


20% 


26% 


32% 


Self 


61-80 


93-96 


14% 


15% 


17% 


18% 


19% 


Understanding 


41-60 


88-92 


17% 


23% 


22% 


22% 


23% 




21-40 


83-87 


24% 


20% 


19% 


17% 


15% 


20 and below 


82 and below 


34% 


28% 


22% 


17% 


11% 


81 and above 


99 and above 


8% 


13% 


17% 


24% 


34% 


Understanding 


61-80 


95-98 


17% 


19% 


22% 


24% 


26% 


Others 


41-60 


92-94 


18% 


18% 


18% 


18% 


14% 




21-40 


87-91 


22% 


22% 


22% 


18% 


14% 


20 and below 


86 and below 


35% 


28% 


21% 


16% 


12% 


81 and above 


584 and above 


5% 


11% 


16% 


25% 


46% 


Basic 


61-80 


526-583 


8% 


16% 


19% 


23% 


27% 


Skills 


41-60 


475-525 


16% 


19% 


22% 


20% 


16% 




21-40 


420-474 


27% 


26% 


22% 


18% 


7% 


20 and below 


419 and below 


44% 


28% 


21% 


14% 


4% 


81 and above 


105 and above 


12% 


17% 


21% 


29% 


45% 


Interes t 


61-80 


98-104 


12% 


17% 


19% 


22% 


22% 


in School 


41-60 


91-97 


15% 


21% 


20% 


20% 


14% 




21-40 


82-90 


24% 


20% 


21% 


16% 


13% 


20 and below 


81 and below 


37% 


25% 


19% 


13% 


6% 


81 and above 


184 and above 


8% 


16% 


20% 


28% 


39% 


Citizenship 


61-80 


174-183 


14% 


' 18% 


22% 


25% 


27% 




41-60 


164-173 


17% 


20% 


21% 


19% 


16% 




21-40 


150-163 


26% 


21% 


20% 


15% 


10% 


20 and below 


149 and below 


35% 


25% 


17% 


13% 


8% 


81 and above 


131 and above 


6% 


12% 


19% 


28% 


38% 


Health 


61-80 


126-130 


12% 


18% 


23% 


27% 


24% 


Habi ts 


41-60 


121-125 


13% 


20% 


20% 


19% 


19% 




21-40 


113-120 


23% 


24% 


20% 


14% 


14% 


20 and below 


112 and below 


46% 


26% 


18% 


12% 


5% 


81 and above 


68 and above 


6% 


12% 


18% 


24% 


33% 


Creative 


61-80 


63-67 


16% 


16% 


19% 


19% 


19% 


Potential 


41-60 


59-62 


19% 


22% 


19% 


20% 


18% 




21-40 


54-58 


36% 


26% 


24% 


21% 


17% 


20 and below 


53 and below 


23% 


24% 


20% 


16% 


13% 


81 and above 


149 and above 


8% 


15^ 


19% 


25% 


34% 


Creative 


61-80 


138-148 


17% 


18% 


19% 


21% 


21% 


Output 


41-60 


131-137 


24% 


20% 


19% 


20% 


15% 




21-40 


124-130 


25% 


24% 


23% 


21% 


18% 


20 and below 


123 and below 


26% 


22% 


20% 


14% 


12% 


81 and above 


89 and above 


12% 


17% 


22% 


27% 


35"% 


Vocational 


61-80 


86-88 


15% 


19% 


22% 


23% 


22% 


Development 


41-60 


83-85 


20% 


19% 


21% 


21% 


19% 




21-40 


79-82 


22% 


21% 


18% 


17% 


16% 


20 and below 


78 and below 


31% 


24% 


17% 


12% 


8% 


81 and above 


174 and above 


13% 


15% 


20% 


28% 


33% 


Appreciating 


61-80 


164-173 


15% 


19% 


21% 


21% 


26% 


Human 


41-60 


155-163 


17% 


21% 


21% 


19% 


17% 


Accomplishments 


21-40 


145-154 


23% 


21% 


18% 


16% 


13% 


20 and below 


144 and below 


32% 


24% 


20% 


16% 


11% 


81 and above 


118 and above 


10% 


16% 


20% 


25% 


33% 


Preparing 


61-80 


110-117 


11% 


18% 


21% 


21% 


24% 


for a 


41-60 


103-109 


18% 


18% 


19% 


20% 


17% 


Changing World 


21-40 


94-102 


21% 


23% 


20% 


19% 


13% 


20 and below 


93 and below 


40% 


25% 


20% 


15% 


13% 
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INTERPRETATION OF THE SCHOOL REPORT 



Materials 

A Pennsylvania Department of Education representative will. report EQA 
findings to the chief school officer of each participating Phase III school 
district. He has attended a workshop conducted by the Bureau of Educational 
Quality Assessment which will help him in the dissemination and interpreta- 
tion of the findings. The Bureau report to each school will contain the 
following: 

- - -Norm charts for condition variables. Each school will receive three 
state norm tables for the condition variables--school and community indices, 
instructional staff indices, and student indices--and its standing on each 
of these variables. 

- - -A marked norm chart for the EQA instruments. A red schoolhouse symbol 
indicates the actual mean performance level of the school's student body on 
each of the ten EQA goals. Two horizontal bars delineate the range of scores 
predicted for that school given the condition variables under which it 
operates. The wide gray band indicates the median school score on each 
instrument . 

- - -An unmarked norm chart for the EQA instruments. Districts with more 
than one participating Phase III school can summarize the schools' obtained 
and predicted scores on this chart. 
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- - -Packet of student distributions and key items on the EQA instruments. 

On ten separate sheets (one for each goal) the quintile distributions of 
the students on each instrument are reported together with the student dis- 
tribution that is expected for the school given its inputs and the state 
normative distribution on each instrument. Each sheet also lists student 
response percentages on key items of that instrument. 

Reading a Norms Chart 

As earlier noted in Section 3 of this manual, a school's score on an 
instrument is compared with two reference groups: (1) a statewide cross 

section of schools (statewide norms) and (2) only those schools whose set 
of condition variables result in a similar expected score (predicted bands). 
Illustration I demonstrates the form these two comparisons take. 

- - - Statewide Norms. The chart allows one to compare a school's actual 
reported score to the statewide reference group and determine the school's 
standing relative to that group on each of the Quality Education Inventories. 

The gray shaded area across the chart designates the median score of 
Phase II schools on each instrument. Displayed at the bottom of the chart 
are the mean and standard deviation of the normative schools on each in- 
ventory. 

By reading across the chart one can find the raw school scores on each 
instrument corresponding to a given percentile rank. For example, a score 
of 91.59 on Self Understanding inventory and a score of 94.73 on the Under- 
standing Others inventory are at the 95th percentile in terms of the state 
norm group. 
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ILLUSTRATION I 

SCHOOL MEAN PREDICTION BANDS 
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- - -Prediction Bands. Separate prediction equations are used to predict 
school means on each instrument. Each equation has its own degree of pre- 
diction error called the standard error of estimate. The widths of the 
prediction bands are determined by adding and subtracting the standard error 
of estimate from the predicted school mean score. 

The marked band in each column indicates the range into which the mean 
for the Phase III school is expected to fall given the conditions under which 
the school has to operate. The condition variables and regression coeffi- 
cients used to make these predictions are discussed in Section 3 of this 
manual. 

Note the location of the band boundaries for Column 2 of the illustra- 
tion. In this hypothetical case the school score on the Self Understanding 
inventory is expected to fall between 90.41 and 89.70. These scores corres- 
pond to state percentile ranks of 85 and 69. Similarly, on Basic Skills the 
school mean is predicted to fall between the 55th and 65th percentiles. 

The widths of the prediction bands (in raw score units) are determined 
by the relationship between the condition variables and the goal instruments. 
School scores on some goal instruments are more highly related to the condi- 
tion variables than are school scores on other instruments. As the ability 
to predict these school outcomes from the sets of condition variables in- 
creases, the prediction bands become more narrow. 

Furthermore, in a given column the apparent physical width of the band 
will differ depending upon whether the school score is predicted to be close 
to or far from the statewide average. This difference in apparent band width 
is an artifact of the norm chart. That equal raw score intervals (the basis 
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of the predicted ranges) translate to different "widths" on the chart can 
be explained by the fact that the "distances" on the chart are based on 
percentile rank distributions of schools and not on the raw scores which 
are used for prediction bands. 

" Aquarius High School " 

Sections of a Phase III report to a hypothetical Aquarius High School 
are given below. Illustrations II and III are presented to give Phase III 
school personnel an idea of the form a school report takes. 

By referring to Illustration II, Aquarius High School's officials can 
first see how their school compares to the state norm group. The position 
of Aquarius in relation to this reference group is given by a "schoolhouse" 
symbol. The line through this symbol's base represents the scorepoint at 
which the Aquarius school mean fell on each quality education inventory. 

Checking the positions of these symbols one might first note that the 
school has scored below the median on the goals of (1) Self Understanding, 
(2) Understanding Others, and (3) Basic Skills. However, its score is above 
the state median on (1) Interest in School, (2) Citizenship, and (3) Health 
Habits. The locations of the bases of the schoolhouse symbols represent 
respective percentile ranks of 11, 39, 39, 53, 91, and 55. 

Looking at the percentile ranks alone suggests the first three goal 
areas to be "problem areas" with Understanding Others and Basic Skills both 
falling at the 39th percentile. When prediction bands for each inventory 
are taken into account, a different and more complete picture of Aquarius 
emerges. 

Even though its mean score on Understanding Others is below 61 out of 
100 schools in the state norm group, Aquarius High School is above its 



predicted band on this inventory. The results of this comparison indicate 
that Aquarius is doing better in the goal area than would be expected given 
the school, student, and community conditions under which it operates. 

On the other hand, the 39th percentile rank of Aquarius on Basic Skills 
falls below the prediction level. In this area Aquarius High School is not 
achieving at as high a level as is expected given the set of conditions 
under which it has to operate. 

On Interest in School the actual score of 93, corresponding to a per- 
centile rank of about 53, falls within the predicted band of 91.78 to 94,39 
(35th to 70th percentiles). (CAUTION: No additional conclusion should be 

drawn because the actual mean falls in the "upper" portion of the range.) 

The predicted high ranges on Citizenship and Health Habits indicate 
that schools in settings similar to Aquarius achieve high scores on these 
instruments. The Aquarius High School scores on both of these instruments 
are also high but above the prediction on Citizenship and below the pre- 
diction on Health Habits. 

On the basis of prediction band comparisons, Aquarius has reason for 
concern in the areas of Self Understanding, Basic Skills, and Health Habits 
because the school is not achieving at as high a level as would be expected 
given the set of conditions with which it has to work. 

On the other hand, Aquarius might want to share with other schools its 
success in overcoming the limitations placed on it. Its success is indicated 
by its higher than predicted scores on Understanding Others and Citizenship. 
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ILLUSTRATION II 

PREDICTION BANDS AND ACTUAL SCORES: "AQUARIUS HIGH SCHOOL" 
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- - -Actual and Predicted Student Distributions. Aquarius High School 
officials, having noted their mean scores on the quality education instru- 
ments and having compared them to both predicted means and statewide norms, 
are provided with the distribution of their students on these inventories. 
The form this report takes for Goal I is shown by Illustration. III. 

ILLUSTRATION III 

PREDICTED AND ACTUAL STUDENT DISTRIBUTIONS ON 
SELF UNDERSTANDING: "AQUARIUS HIGH SCHOOL" 

GOAL I - SELF-UNDERSTANDING 





Student Distributions 


Percentile Rank 


State Norm 


School 

Prediction 


School Actual 


81 or above 


19% 


14% 


5% 


61-80 


20% 


15% 


5% 


41 - 60 


22% 


23% 


20% 


21-40 


19% 


20% 


26% 


20 or below 


20% 


28% 


44% 



Column 2 in the illustration gives the per cent of Phase II students 
scoring in each of five raw score intervals on the Self Understanding 
inventory. Column 3 displays the way students in Aquarius are expected to 
distribute themselves on the inventory. (For information on how this pre- 
diction was developed, see page 49 of this manual. ) Column 4 shows how the 
students actually distributed themselves on Self Understanding. 

Note that a large percentage of Aquarius High School's 11th grade stu- 
dents scored very low on the inventory (i.e., 44% fall in the lowest score 
range). Also note that a very low percentage of its students score in the 
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upper score ranges of the instrument. The comparison between percentages 
in Column 2 and 4 reveals that the actual distribution does not compare 
favorably to the state distribution. Furthermore, the Aquarius School has 
a less favorable student distribution on this inventory than it is expected 
to have given the conditions under which it is operating. 

_ _ -Key items. The possibility always exists that the school's student 
body is achieving exactly as it is predicted to achieve on the basis of 
the school, community and home conditions that make up its environment. 
However, the school's student achievements in the goal areas may be far 
from satisfactory in terms of thoughtful and serious value judgments of 
concerned educators. 

To aid in such a criterion reference and to allow Aquarius school 
officials to see the student replies which contributed to the school's 
score, percentage replies to key items on each inventory are reported on 
each goal sheet. 
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